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INTRODUCTION 



The conceptual and technical design of large-scale assessments which can 
better capture educational effects has received considerable attention in recent years 
<e.gv Baker & Herman, 1986; Burstein, 1989; Burstein et al., 1986; Cole, 1988; Linn, 
1987, 1989; Muth^n, 1989; Muth4n, et al., 1988). The basic rational for incorporating 
information about instructional experiences in the design and analysis of 
assessment data is that student abiMty, topic exposure, and forms of instructional 
exposure each contribute to student performance as measured at a given point in 
time. 

As we have discussed in earlier reports, collecting information about content 
coverage as part of large-scale assessments can be valued on several grounds. First, 
many studies (e.g., Berliner, 1980; Burstein et al. (in press); Leinhardt & Seewald, 
1981; Leinhardt, 1983; Schmidt, 1983) show that various forms of measuring content 
coverage are invaluable in accounting for student performance. Second, measures 
of instructional coverage have served as a means of evaluating the match between 
the content of tests and the subject matter (experiences that students have had (e.g., 
Leinhardt & Seewald, 1981). Such measures also are useful in examining the 
sensitivity of test items to differences in instructional experiences of individual 
students and groups of students. 

The purpose of this study is to investigate the degree of consistency of 
teachers' content coverage reports with logical expectations about the contents of a 
course with a given title and student composition for two consecutive years and to 
detect the effects of content coverage by comparing student performance patterns 
associated with teachers' reports of content coverage for 1988 ai\d 1989 data collected 
in the context of an ongoing examination of instructional assessment in secondary 
school mathematics. The results of the data analysis for 1988 was reported earlier 
(Burstein, Chen & Kim, 1988). This study followed the same procedures using 1989 
data, and compared the results aaoss two years. We consider the validity of certain 
means of gathering information about students' instructional experiences and view 
student test performance as corroborating evidence. Evidence that reported content 
coverage pattern are similar across years may suggest that the chosen means of 
collecting such data has functioned as expected under the "steady state" curricular 
conditions prevalent in participating schools. Any deviations in reporting patterns 
across years should be dictated either by (a) the performance of a teachers' students 
the previous year or (b) differences in class composition across years. 



DATA 



The data were collected from teachers who volunteered to participate in the 
Mathematics Diagnostic Testing Program (MDTP). Under this project, the 
University of California and California State University systems have developed a 
series of four diagnostic tests (Algebra Readiness, Elementary Algebra, Intermediate 
Algebra, and Precalculus) to be used voluntarily in secondary and middle schools in 
California in an effort to improve mathematics education. In this study, analyses 
are based on teacher and student data from approximately 300 sections (176 sections 
3 districts, 8 schools in 1988 and 112 sections 3 districts, 10 schools in 1989) of 
mathematics spanning couri^es in Pre Algebra, Math A, Math B, Algebra I, and 
Geometry. To compare p-values across 1988 and 1989, the Algebra Readiness and 
Elementary Algebra (1987 form of Elementary Algebra for 1989 data) tests developed 
by MDTP were used. 

INSTRUMENTATION 

III our instrumentation, teachers are presented with different math topics and 
are asked to indicate how these topics are covered in each mathematics course they 
teach, using the following set of response options: 

a. NEW - Taught as new content 

b. EXTENDED - Reviewed and Extended 

c. REVIEW Reviewed only 

d. ASSUMED Assumed as prerequisite knowledge & neither taught nor 

reviewed. 

e. TAUGHT LATER Taught later in the school curriculum 

f. NOT IN CURRICULITM - Not in the school curriculum 

g. DONT KNOW - Not taught now and don't know if in 

school curriculum. 



These seven response alternatives are adapted from Opportunity to Learn 
questions and topic specific teacher questionnaires used in the Second International 
Mathematics Study.^ 

The questionnaire included topics which were identified as included in any of 
the four tests developed by MDTP or in the secondary school mathematics grid 
developed as part of an earlier study of the content validity of MDTP tests (Burstein, 
Aschbacher, Chen, Lin, & Sen, 1986). Thus the questionnaire was expected to span 
to the course material for college-preparatory s&condary school mathematics, 
necessitating an extensive list of topics (97 topics classified into 12 distinct 
subgroups): integers (4 topics); fractions, decimal, ratio, proportion, and percent (14); 
exponents, radicals, and square roots(14); polynomials (12); algebraic equations (11); 
inequalities (3); rational expressions (4); probability and statistics (2); geometry (15); 
absolute value (2); functions (10); and trigonometry (6). 

METHODS FOR ANALYZING PATTERNS OF TOPIC COVERAGE 

There is no clear operational standard for examining the degree of consistency 
between teachers' content coverage and the effects of content coverage. In this study 
as in Burstein, Chen, & Klm|1988), patterns of responses was examined which 
should align with logical expectations about the contents of a course with a given 
title and student composition across two years. And also p-values matched with 
teachers' responses on content coverage were computed. 

The first sets of analyses with the teacher data involved the percentage of 
teacher responses regarding their topic coverage. We examine the responses within 
and between courses in the 12 broader topic categories. These patterns should be 
consistent with logical expectation for the topic vithin a given course, and when a 
topic clearly aligns with a given course, virtually all teachers claiming to teach that 
course should be stating that the topic is taught as New(A) or perhaps Extended (B). 
Percentage of responses (topic by type of coverage) were tabulated for course sections 
assigned to six categories (Lower than Pre-Algebra, Math A, Math B, Pre-^\lgebra, 
Algebra I, Geometry) for 1988 and 1989 in Table 1 (Attachment 1). Note that in 
addition to percentage tabulations of actual responses, certain combinations of 



^This data is a national sample of United States 8th grade students mathematics achievement tests 
conducted by lEA (the International Association for the Evaluation of Educational achievement) in 
1981-1982. 



responses (eg.. Taught (A+B+C), Taught + Extended (A+B), Extended + Review 
(B+C), Review + Assumed (C+D), Not Taught and Not Assumed (E+F+G+Missing) 
were also tabulated. As shown in Table 1, these percentage data describe the 
characteristics of both the apparent topical emphases in given courses and whether 
these emphases are different across sections of the course. 

The second sets of analyses report on an attempt to identify which topics are 
•Core' for a given course. We proceeded with a strategy to identify from the 1988 
and 1989 empirical data those topics that were taught almost uniformly within a 
course type (operationally 80% of teachers classified as Taught as ^Jew (response A) 
or Extended (B)); such topics assnmed to be 'Core' topics. Similarly topics were 
classified as Prior (C+D), and Not taught (E+F-Kj) under 80% of teachet s' responses 
were in the indicated category. Topics not falling in any of these categories are also 
identified. For example, if more than 80% of teachers in Lower than Pre-Algebra 
classes responded that they taught a topic as New and Extended (A+B), then it was 
marked as 'C (Core)'. The results are reported in Table 2 (Attachment 2). 

The third set of analyses relates the teacher topic coverage response data and 
its relationship to student performance. The descriptive results of what teachers 
ddmed to teach at various levels are interesting in and of themselves, but the 
validity of such data might be questioned. Therefore, we decided to ascertain 
whether the specific response choices corresponded in a systematic way with 
performance on MDTP and SIMS Benchmark^ test items measuring a given 
subtopic. The three tests administered to students in the course types were 
considered here. Those are the MDTP Algebra Readiness and Elementary Algebra 
tests and the six short forms of the A level of the SIMS Benchmark tests. Depending 
on the course in which students are exu:olled, they will have taken either the MDTP 
Algebra Readiness (Lower than Pre Algebra, Math A, Math B, Pre Algebra) or 
Elementary Algebra (Algebra I and Geometry) tests and one of the six randomly 
assigned forms of the SIMS Benchmark test. Performance on test items in a given 
topic area should be consistent with teachers' report of coverage of these topics. The 
Table 3 (Attachment 3) shows the results of these analyses. 



2 SIMS Benchmark tests contained 46 items selected from the SIMS p^l administered at grade 8. 
Hiese items were assigned to one of the six forms with two items coinmon across all forms and the 
remainder allocated to forms to achieve a rough balance in content and difficulty using SMS 
performance levels as a guide regarding the latter. 



RESULTS 



Across courses and topics in general, the patterns of responses are consistent 
with what might be the expected curriculum patterns in mathematics courses at this 
level across 1988 and 1989. In Lower than Pre Algebra, nothing is assumed to have 
been taught before and the vast majority of the topics are judged to be taught later or 
are not in the curriculum in both 1988 and 1989. Only operations with common and 
decimal fractions and ratio, proportion, and percent problems were taught as 'Core' 
by more than 80% of teachers in both years. 

In Math A and Math B, almost nothing is assumed to have been taught 
before, but the subtopics taught in Lower than Pre Algebra were reviewed. And 
more than 80% of teachers taught as 'Core' the topics taught as 'Core' in Lower than 
Pre Algebra plus the subtopics such as exponents, powers, perfect squares, addition & 
subtraction of square roots in 1988 while more than 80% of teachers taught those 
topics as Trior' and 'Core' in 1989. Teachers were more likely to teach higher level 
subtopics, such as linear equations, Pythagorean Theorem as 'Core' in 1989 
compared to 1988. Teachers' responses on these topics differ mainly because these 
courses are newly created courses in California and are under development. 

In Pre Algebra almost all teachers taught or extended the topics within our 
subcategories integers, fractions/ratio/proportion/percent, and exponents, but 
otherwise there is much diversity in both years. Some teachers apparently treat Pre 
Algebra as beginning Algebra with light introductions to Algebra topics, while 
others consider it the final opportunity to make sure all arithmetic topics are well 
understood. 

Topic ^ overage in Algebra I concentrates on the traditional core of 
introductory algebra (exponents, polynomials, algebraic equations, inequalities, 
rational expressions, absolute value). More than 80% of teachers responded that 
these topics were taught as 'Core' in both years. Topics that differentiate among 
subsets of Algebra I sections reflect time devoted to extending and reviewing 
common and decimal fractions versus those involving enriched preparation for 
future courses (e.g., geometry topics, function concepts). 

In Geometry, there was essentially a universal core of topic? with any 
differentiation associated with whether higher level arithmetic topics are reviewed 
or assumed, whether the Algebra core is reviewed, or whether special 
Geometry/Trigonometry topics (e.g.. Transformations, Vectors) are introduced. 
More than 80% of teachers taught all subtopics in Geometry as 'Core' while 



transformations and vector? were taught as 'Core' only by 36%(1988) and 45%(1989) 
of the teachers. The results above showed that the prevalence and type of coverage 
of topics were consistent with their typical position within the curriculum aaoss 
both years. 

The pattern of performance on items from the MDIP tests classified according 
to topic and specific teachers' reports of content coverage agree with expectations, 
but are somewhat uneven. Item p-values were highest when a topic was claimed to 
have been taught as 'Assumed as Prerequisite' in Algebra Readiness of 1989 and 
SIMS Benchmark both years, while p-values for that category on Algebra Readiness 
in 1988 were quite low. This apparent difference is exceptional; very few teachers 
(typically no more than 1 or 2) chose 'Assumed as Prerequisite' for any one item on 
these tests so the p-values are not very stable for this response alternative on this 
test. For both Algebra Readiness and SIMS Benchmark, p-values were highest when 
topics were indicated as 'Taught as New' with 'Assumed as Prerequisite' taken out 
of consideration. F-values were lowest when topics were indicated as 'Not in 
Curriculum', 'Don't Know' and 'No Response' in MDTP Algebra Readiness both 
years. For the SIMS Benchmark items, the simple rank ordering of average p-values 
appears confusing because of high p-values for Taught Later, Not in Curriculum, 
and Don't know for both years. But only one or two teachers chose Not in 
Curriculum responses for 19 of the 7.3 items in 1988 and tv/o teachers chose Not in 
Curriculum responses for 23 out of the 27 items in 1989 falling in this response 
category. Because of the limited number of respondents, therefore, inference from 
these data are hazardous. Otherwise, the patterns of performance are associated 
with response alternatives as expected. Further, even though the patterns of 
performance in the SIMS Benchmark did not show dear patterns of performance 
associated with responses, when there is sufficient data to warrant some confidence 
in performance data, the patterns of performance associated with given response 
options are roughly as expected. 

IMPUCATIONS 

Our results showed that a quertionnaire approach to soliciting data on types 
of topic coverage seems to give plausible information about content emphases in 
instruction. The merits of using teachers' reports of content coverage lie in their 
feasibility and efficiency. Completion of our instrument required 30 minutes or 
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less. However, some patterns in the results were aberant, raising questions about 
the sensitivity of the measure in its current form and about how much confidence 
can be placed in seemingly simple assessments of content coverage of the type 
considered here. Further research, is needed to refine the approach and its 
validation methodology of particular interest are questions of what constitutes a 
reasonably sound relationship between teacher reports and student performance. 
Whether expected relationships are similar across different types of classes is 
another issue for exploration. 
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.000 
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.005 
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. 122 
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.025 
.047 
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.233 
.857 


0.00 
0.00 


.071 
0.00 


.014 
0.00 


0.00 
0.00 


0.00 
0.00 


.914 
1 .00 


.333 
.857 
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0.00 
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0.00 
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.267 
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0.00 
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.300 
0.00 


0.00 
0.00 


0.00 
0.00 


.400 
0.00 


.300 
1 .00 


0.00 
0.00 


.300 
1.00 


0.00 
0.00 


.700 
0.00 


9. 


GEOMETRY 


'88 
'89 


.080 
.444 


.040 
.133 


0.00 
0.00 


0.00 
0.00 


.467 
.178 


0.00 
.244 


.013 
0.00 


.400 
0.00 


. 120 
.576 


.O'lO 
.133 


.120 
.578 


0.00 
0.00 


.880 
.422 


10. 


ABSOLUTE 


'88 
'89 


.100 
.667 


0.00 
0.00 


0.00 
0.00 


0.00 
0.00 


.500 
0.00 


0.00 
.333 


0.00 
0.00 


.400 
0.00 


.100 
.667 


0.00 
0.00 


.100 
.667 


0.00 
0.00 


.900 
.333 


11. 


FUNCTIONS 


'88 
•69 


.100 
.133 


0.00 
0.00 


0.00 
0.00 


0.00 
0.00 


.460 
.533 


0.00 
.333 


.040 
0.00 


.400 
0.00 


. 100 
.133 


0.00 
0.00 


.100 
.133 


0.00 
0.00 


.900 
.867 


12. 


TRIGONOMETRY 


'88 
•89 


0.00 
.111 


o.oo 

0.00 


0.00 
0.00 


0.00 
0.00 


.600 
.556 


0.00 
.333 


0.00 
0.00 


.400 
0.00 


0.00 
.111 


0.00 
0.00 


0.00 
.111 


0.00 
0.00 


1 .00 
.869 






'68 
•89 


.247 
.409 


.033 
.041 


.038 
.124 


.010 
.007 


.353 
.192 


.002 
.220 


.016 
0.00 


.301 
.007 


.318 
.574 


.071 
.165 


.280 
.450 


.046 
.131 


.672 
.419 
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MDTP88/89- TEACHER QUESTIONNAIRE - TOP 
TOPIC BY TOPIC (12 CATEGORIES) 



IC COVERAGE 
« PERCENTAGE 



COURSE 



MATH B 



COURSE MEAN 





TOPIC 




NEW 
A 


EXTE 
NDED 

B 


REVI 
EWED 

C 


ASSU 
MED 

D 


TAUG 
HT L 
ATER 
E 


NOT 
IN C 
URRI 
F 


NOT 
KNOW 

0 


MISS 
ING 

M 


A+B 

+c 


B+C 


A+B 


C+D 


1 . 


1 NTEGERS 


'88 
'89 


0.00 
.U17 


.850 
.333 


.150 
0.00 


0.00 
.250 


0.00 
0.00 


O.OC 
0.00 


O.UO 
0.00 


0.00 
0.00 


1.00 
.750 


1.00 
.333 


.850 
.750 


.150 
.250 


2. 


FRACTIONS 


'88 
'89 


0.00 
.071 


.771 
0.00 


0.00 
.929 


0.00 
0.00 


0.00 
0.00 


0.00 
0.00 


0.00 
0.00 


.229 
0.00 


.771 
1.00 


.771 
.929 


.771 
.071 


0.00 
.929 


3. 


EXPONENTS 


'88 
'89 


.Ult} 
.U32 


0.00 
0.00 


0.00 
.02U 


0.00 
0.00 


.01U 
.262 


.UOO 
.262 


0.00 
0.00 


.171 
0.00 


.U1U 
.U76 


0.00 
.02U 


.U1U 
.U52 


0.00 
.02U 


U. 


POLYNOMIALS 


'88 
'89 


.183 
.333 


0.00 
0.00 


0.00 
0.00 


0.00 
.306 


.017 
0.00 


.800 
.333 


0.00 
0.00 


0.00 
.028 


.183 
.333 


0.00 
0.00 


.183 
.333 


0.00 
.306 


5. 


ALGEBRAIC EQU. 


'88 
'89 


.145 
.162 


0.00 
.212 


0.00 
.061 


0.00 
.061 


.055 
.273 


.800 
.212 


0.00 
0.00 


0.00 
0.00 


.1U5 
.U55 


0.00 
.273 


.1U5 
.39U 


0.00 
.121 


6. 


INEQUALITIES 


'88 
'89 


.200 
.111 


0.00 
.222 


0.00 
0.00 


0.00 
0.00 


0.00 
.333 


.800 
.333 


0.00 
0.00 


0.00 
0.00 


.200 
.333 


0.00 
.222 


.200 
.333 


0.00 
0.00 


7. 


RATIONAL EXPO. 


'88 
•89 


.150 
.167 


0.00 
.500 


0.00 
0.00 


0.00 
0.00 


.050 
.167 


.800 
.167 


0.00 
0.00 


0.00 
0.00 


.150 
.667 


0.00 
.500 


.150 
.667 


0.00 
0.00 


e. 


PROB. & STATS. 


'88 
'89 


.800 
.667 


0.00 
.333 


0.00 
0.00 


0.00 
0.00 


.200 
0.00 


0.00 
0.00 


0.00 
0.00 


0.00 
0.00 


.800 
1.00 


0.00 
.333 


.800 
1 .00 


0.00 
0.00 


9. 


CroMETRY 


'88 
'89 


0.00 
.200 


.160 
.333 


0.00 
0.00 


0.00 
0.00 


.200 
.222 


.6U0 
.2UU 


0.00 
0.00 


0.00 
0.00 


.160 
.533 


.160 
.333 


.160 
.533 


0.00 
0.00 


10. 


ABSOLUTE 


'88 
'89 


0.00 
.167 


0.00 
.500 


0.00 
0.00 


0.00 
0.00 


.200 
0.00 


.600 
.333 


0,00 
0.00 


0.00 
0.00 


0.00 
.667 


0.00 
.500 


0.00 
.667 


0.00 
0.00 


11. 


FUNCTIONS 


'88 
'89 


0.00 
.033 


0.00 
.167 


0.00 
0.00 


0.00 
0.00 


.200 
.U67 


.800 
.333 


0.00 
0.00 


0 00 
0.00 


0.00 
.200 


0.00 
.167 


0.00 
.200 


0.00 
0.00 


12. 


TRIGONOMETRY 


'88 
'69 


0.00 
.056 


0.00 
0.00 


0.00 
0.00 


0.00 
0.00 


.200 
.611 


.800 
.333 


0.00 
0.00 


0.00 
0.00 


0.00 
.056 


0.00 
0.00 


0.00 
.056 


0.00 
0.00 






'88 
'89 


.128 
.220 


.171 
.151 


.006 
.1UU 


0.00 
.055 


.085 
.206 


-.553 
.220 


0.00 
0.00 


.058 
.003 


.305 
.515 


.177 
.296 


.299 
.371 


.006 
.199 



e 

+F+G 



0.00 
0.00 

.229 
0.00 

.586 
.524 

.817 
.361 

.855 
.U85 

.800 
.667 

.850 
.333 

.200 
w.OO 

.8U0 
.U67 

1.00 
.333 

1.00 
.800 

1.00 
.9U4 

.695 
.U30 
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MDTPea/89- TEACHER QUESTIONNAIRE - TOP 
TOPIC BY TOPIC (12 CATEGORIES) 



10 COVERAGE 
> PERCENTAGE 



COURSE 



PRE-ALGEBRA 



COURSE MEAN 





TOPIC 




NEW 
A 


EXTE 
NDEO 

B 


REVI 
EWEO 

C 


ASSU 
MEO 

0 


TAUG 
HT L 
ATER 
E 


NOT 
IN C 
URRI 
F 


NOT 
KNOW 

G 


MISS 
ING 

M 


A+B 
+C 


B+C 


A+B 


C+D 


r 

+F+G 
+M 


1. 


1 NTEOERS 


•83 
'69 


.U68 
.673 


.376 
.096 


.135 
.15U 


0.00 
.077 


.013 
0.00 


.006 
0.00 


0.00 
0.00 


0.00 
0.00 


.961 
.923 


.513 
.250 


.8U6 
.769 


.135 
.231 


.019 
0.00 


2. 


FRACTIONS 


'68 
'69 


.185 
.UU5 


.U<«0 
.2U7 


.370 
.21*7 


.OOU 
.060 


.002 
0.00 


0.00 
0.00 


0.00 
0.00 


0.00 
0.00 


.995 
.9U0 


.810 
.U95 


.625 
.692 


.37U 
.308 


.002 
0.00 


3. 


EXPONENTS 


'88 
'69 


.U80 
.330. 


.06U 
.027 


.013 
.077 


O.OU 
.016 


.332 
.220 


.112 
.209 


0.00 
0.00 


0.00 
.121 


.557 
.U3U 


.077 
.10U 


.5UU 
.357 


.013 
.093 


.UU3 
.5U9 


ti. 


POLYNOMIALS 


•86 
'89 


.218 
.167 


.OOU 
.006 


0.00 
.026 


0.00 
.0U5 


.630 
.397 


.130 
.205 


0.00 
0.00 


.017 
.15U 


.222 
.199 


.OOU 
.032 


.222 
.173 


0.00 
.071 


.778 
.756 


5. 


ALGEBRAIC EQU 


'88. 
'89 


.235 
.357 


.023 
.014 


0.00 
.0U9 


0.00 
.014 


.59U 
.210 


.12U 
.203 

1 


.01U 
0.00 


.009 
.15U 


.259 
.U20 


.023 
.063 


.259 
.371 


0.00 
.063 


.7U1 
.566 


6. 


INEQUALITIES 


'88 
'69 


.316 
.UIO 


0.00 
0.00 


0.00 
.026 


0.00 
0.00 


.590 
.205 


.09U 
.205 


Q.OO 
0.00 


0.00 
.15'* 


.316 
.U36 


0.00 
.026 


.316 
.UIO 


0.00 
.026 


.684 
.564 


7. 


RATIONAL EXPO 


'88. 
'89 


.500 
.U62 


0.00 
0.00 


0.00 
0.00 


0.00 
.077 


.3U0 
.15U 


.1U1 
.15U 


.019 
0.00 


0.00 
.15U 


.500 
.U62 


0.00 
0.00 


.500 
.U62 


0.00 
.077 


.500 
.462 


8. 


PROB. 83 STATS 


'66. 
'89 


.077 
.036 


.359 
.115 


0.00 
0.00 


0.00 
0.00 


.231 
.385 


.179 
.308 


.15U 
0.00 


0.00 
.15U 


.U36 
.15U 


.359 
.115 


.U36 
.15U 


0.00 
0.00 


.564 
.846 


9. 


GEOMETRY 


•66 
'89 


.253 
.U62 


.173 
.067 


.lUO 
.010 


0.00 
0.00 


.29U 
.15U 


.126 
.1U9 


.01U 
.005 


0.00 
.15U 


.566 
.536 


.313 
.077 


.U26 
.528 


.1U0 
.010 


.434 
.462 


10. 


ABSOLUTE 


•68 
'89 


.603 
.385 


0.00 
0.00 


0.00 
.077 


0.00 
0.00 


.321 
.231 


.077 
.15U 


0.00 
0.00 


0.00 
.15U 


.603 
.U62 


0.00 
.077 


.603 
.385 


0.00 
.077 


.397 
.538 


11. 


FUNCTIONS 


'88 
'89 


.026 
0.00 


0.00 
0.00 


0.00 
0.00 


0.00 

coo 


.615 
.U62 


.313 
.365 


.0U6 
0.00 


0.00 
.15U 


.026 
0.00 


0.00 
0.00 


.026 
0.00 


0.00 
0.00 


.974 
1 .00 


12. 


TRIGONOMETRY 


'88 
'89 


.103 
.036 


0.00 
0.00 


0.00 
0.00 


0.00 
0.00 


.303 
.U62 


.295 
.3U6 


0.00 
0.00 


0.00 
.15U 


.103 
.038 


0.00 
0.00 


. 103 
.036 


0.00 
0.00 


.897 
.962 






'88 
'89 


.26! 
.315 


. 126 
.059 


.OBi) 
.066 


.001 
.025 


.38U 
.230 


.131 
.185 


.012 
.001 


.003 
.121 


.U69 
.U39 


.208 
.125 


.387 
.37U 


.083 
.090 


.530 
.536 
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M0TP88/89 - TEACHER QUESTIONNAIRE - TOPIC COVERAGE 
TOPIC BY TOPIC (12 CATEGORIES), PERCENTAGE 



COURSE 



ALGEBRA 1,2 
<0R ALGEBRA I) 



COURSE MEAN 





TOPIC 




NEW 
A 


EXTE 
NOEO 

B 


REVI 
EWED 

C 


ASSU 
MED 

0 


TAUG 
HT L 
ATER 
E 


NOT 
IN C 
URRI 
F 


NOT 
KNOW 

G 


MISS 
ING 

M 


A+B 
♦C 


B+C 


A+B 


C+0 


1 

+F+I 
+1 


1. 


1 NTEGERS 


'88 
'89 


.352 
.420 


.328 
.150 


.141 
.290 


.141 
.140 


0.00 
0.00 


0.00 
0.00 


0.00 
0.00 


.039 
0.00 


.820 
.860 


.469 
.440 


.680 
.570 


.281 
.430 


.039 
0.00 




FRACTIONS 


'88 
'89 


.105 
.117 


.435 
.389 


.185 
.380 


.275 
.097 


0.00 
0.00 


0.00 
.006 


0.00 
0.00 


0.00 
.011 


.725 
.886 


.621 
.769 


.540 
.506 


.460 
.477 


0.00 
.017 


3. 


EXPONENTS 


'88 
'89 


.743 
.594 


.085 
.123 


.020 
.051 


.004 
.023 


. 141 
.114 


0.00 
0.00 


0.00 
.014 


.007 
.080 


.84? 
.769 


. 105 
.174 


.82C 
.717 


.025 
.074 


.147 
.209 


U. 


POLYNOMIALS 


'88 
'89 


.8UU 
.890 


.112 
.053 


0.00 
0.00 


0.00 
.047 


.044 
.010 


0.00 
0.00 


0.00 
0.00 


0.00 
0.00 


.956 
.943 


.112 


.956 
.943 


0.00 
.047 


.044 
.010 


5. 


ALGEBRAIC EQU 


'88 
'89 


.838 
.789 


.080 
.084 


0.00 
0.00 


0.00 
.040 


.077 
.087 


0.00 
0.00 


0.00 
0.00 


.006 
0.00 


.918 
.873 


.080 
.084 


.918 
.873 


0.00 
.040 


.082 
.087 


6. 


1 NEQUAL 1 T 1 ES 


'88 
'89 


.833 
.720 


.083 
0.00 


0.00 
0.00 


0.00 
.040 


.093 
. 187 


0.00 
0.00 


0.00 
0.00 


0.00 
.053 


.917 
.720 


.083 
0.00 


.917 
.720 


0.00 
.040 


.083 
.240 


7. 


RATIONAL EXPO 


'88 
'89 


.8UU 
.960 


.094 
0.00 


0.00 
0.00 


0.00 
.040 


.062 
0.00 


0.00 
0.00 


0.00 
0.00 


0.00 
0.00 


.937 
.960 


.094 
0.00 


.937 
.960 


0.00 
.040 


.062 
0.00 


8. 


PROB. & STATS 


'88 
'89 


.187 
.080 


.109 
.120 


0.00 
0.00 


0.00 
0.00 


.656 
.160 


0.00 
.160 


.047 
.220 


0.00 
.260 


.297 
.200 


. 109 
. 1?0 


.297 
.200 


0.00 
0.00 


.703 
.800 


9. 


GEOMETRY 


'88 
'89 


.217 
.200 


.098 
. 101 


.027 
.048 


.085 
.061 


.552 
.360 


.012 
.123 


.008 
0.00 


0.00 
.107 


.342 
.349 


. 125 
.149 


.315 
.301 


.112 
. 109 


.573 
.589 


10. 


ABSOLUTE 


'88 
'89 


.059 
.840 


.047 
.040 


0.00 
0.00 


0.00 
.040 


.031 
0.00 


0.00 
0.00 


.062 
0.00 


0.00 
.080 


.906 
.880 


.047 
.040 


.906 
.880 


0.00 

. o4o 


.094 


11. 


FUNCTIONS 


♦88 
'89 


.262 
.192 


0.00 
.016 


.062 
0.00 


0.00 
0.00 


.650 
.232 


.025 
.120 


0.00 
.200 


0.00 
.240 


.325 
.?.08 


.062 
.016 


.262 
.208 


.062 
0.00 


.675 
.792 


12. 


TRIGONOMETRY 


'88 
'89 


.005 
.040 


0.00 
0.00 


.062 
0.00 


0.00 
0.00 


.927 
.360 


.005 
.160 


0.00 
.200 


0.00 
.24U 


.068 
.040 


.062 
0.00 


.005 
.040 


.062 
0.00 


.932 
.960 






'88 
'69 


.479 
.U5U 


. 136 
.117 


.050 
.082 


.059 
.047 


.264 
.139 


.005 
.045 


.004 
.040 


.003 
.078 


.666 
.652 


. 186 
.198 


.616 
.570 


. 109 
. 128 


.275 
.301 
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COURSE 



GCOMETRY 



COURSE MEAN 



M0TP88/89 - TEACHER QUESTIONNAIRE - TOPIC COVERAGE 
TOPIC BY TOPIC (12 CATEGORIES), PERCENTAOL 



TOPIC 



NEW EXIE REV I ASSU TAUG NOT 

NOED EWED MED HT L IN C 

ATER URR I 

A B C 0 E F 



NOT 
KNOW 



Miss 

ING 
M 



A+B 
+C 



B+C A+B 



E 

+F+G 
C+0 +M 



1. 


INTEGERS 


'88 
•89 


.023 
.167 


.170 
.238 


.239 
.214 


.568 
.381 


0.00 
0.00 


2. 


FRACTIONS 


'88 

*89 


.042 
.C48 


.227 
.327 


.2^'6 
.381 


.448 
.231 


.006 
.014 


3. 


EXPONENTS 


»88 
'89 


.149 
.160 


.201 
.245 


.351 
.259 


.169 
.116 


.055 
.150 


U. 


POLYNOMIALS 


'88 
•89 


.038 
.063 


.201 
.028 


.360 
.476 


.7.42 
.337 


.068 
.052 


5. 


ALGEBRAIC EQU 


'88 
'89 


.037 
.052 


.194 
.199 


.256 
.346 


.347 
.190 


.050 
.074 


6. 


INEQUALITIES 


'88 
'89 


0.00 
.032 


.152 
0.00 


.182 
.175 


.439 
.048 


.091 
.175 


7. 


RA'l 1 CNAL EXPO 


'88 
'89 


0.00 
.095 


.182 
0.00 


.227 
.476 


.409 
.190 


.045 
0.00 


8. 


PROS. & STATS 


'88 
•89 


0.00 
0.00 


.091 
.048 


0.00 
0.00 


0.00 
0.00 


.591 
.429 


9. 


GEOMETRY 


'88 
'89 


.721 
.638 


.091 
.140 


.033 
.013 


.009 
.010 


.079 
.092 


10. 


ABSOLUTE 


'88 
•89 


.182 
.190 


.091 
0.00 


.182 
.357 


.227 
.048 


.091 
.310 


11. 


FUNCTIONS 


'88 
'89 


.091 
.086 


.009 
0.00 


.055 
.029 


.059 
.024 


.686 
.362 


12. 


TRIGONOMETRY 


'88 
'89 


.197 
.143 


0.00 
0.00 


0.00 
0.00 


.045 
0.00. 


.689 
.361 






'88 
'89 


.174 
.176 


.147 
.141 


.203 
.237 


.227 
.143 


.167 
.134 



0.00 0.00 0.00 



.029 
.054 



.033 
.05? 

.091 
.143 

.091 



.136 
.266 

.006 
.092 



.050 
.262 

.023 
.238 

.027 
.087 



.045 
.017 



0.00 .091 
.044 0.00 



.058 
.087 

O.OC 
.238 

0.00 
.238 

.136 
.238 

.015 
.016 



.091 .091 
.095 0.00 



0.00 
0.00 

0.00 
0.00 

.025 
0.00 

.045 
.190 

.045 
0.00 

.045 
0.00 

.045 
O.CO 

.045 
0.00 



.005 .045 

.238 0.00 

0.00 .045 

.238 0.00 



.432 .409 

.619 .452 

.545 .503 

.755 .707 

.701 .552 

.663 .503 

.598 .561 

.567 .504 

.488 .450 

.597 .545 

.333 .333 

.206 .175 

.409 .409 

.571 .476 

.091 .091 

.048 .048 

.845 .124 

.790 .152 



.455 
.548 

.155 
.114 



.273 
.35 V 

.064 
.029 



.032 
.076 



.022 
.006 



.197 0.00 

.143 0.00 

.524 .350 

.553 .378 



.193 
.405 


.807 
.595 


0.00 
0.00 


.269 
.374 


.724 
.612 


.006 
.014 


.351 
.405 


.S19 
.374 


.130 
.221 


.239 
.091 


.602 
.813 


.159 
.095 


.231 
.251 


.603 
.537 


.165 
.212 


.152 
.032 


.621 
.222 


.227 
.746 


.182 
.095 


.636 
.667 


.182 
.238 


.091 
.048 


0.00 
0.00 


.909 
.952 


.812 
.778 


.042 
.022 


.145 
.200 


.273 
.190 


.409 
.405 


.318 
.405 


.100 
.086 


.114 
.052 


.786 
.662 


.197 
.143 


.045 
O.OO 


.758 
.857 


.321 
.317 


.431 
.380 


.248 
.303 
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COURSE 



TOPIC 



MDTP 88 - TEACHER QUESTIONNAIRE - TOPIC COVERAGE 
TOPIC BY TOPIC (12 CATEGORIES), PERCENTAGE 

NEW EXTE REV I ASSU TAUO NOT NOT MISS 
NOED EWEO MED HT L IN C KNOW ING 

ATER URRI 

AOCDEFGM 



A+B 
+C 



B+C A-t-B 



E 

+F+G 
C+D +M 



TOTAL 



Its 'il? '9^9 •9!*5 .311 .112 .01U .073 .Ut*5 .186 .375 .116 .510 

'89 .284 .Q9k .107 .Qk& .2U1 .160 .027 .039 .U85 .201 .378 !l55 .467 




Attachment 2 
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1988 lEACHER CONTENT COVERAGE BY COURSES - BY SUBTOPIC 
(80% Teachers' agreement on each topic) 



ITEMS 

- - 


LOWIiRTHAN 


MATH A 


MATHB 


PRE 


ALGBBRA 


GBOMBT 


PRE 
ALGEBRA 






at/:rrpa 


i 




..At 


4i 






P/IQN 
L(JoJ 




D/ 1 0\ 


-^^ yvrZ PKlMn FACTURiZATlUM 


4i 


p/ 1 o\ 


A/<k\ 




C(27) 


D/ 1 Q\ 


« ttnxiT>TKr^ istc'paxt^dc nxr XTTTHiracD t tntd* 
■■ ■ 9 l^lMOlNy UISTAMLu UN MUMocK LuNC 


4i 




4i 


C(35) 


4i 




4 UolMu i/crlMiTlUM vr UlVIoiiiU4i Y 


4i 




4i 


4i 


4i 




\ 9 ADD* & SUB* Ur rKAWmUISS 


A^K\ 




P/C\ 


4i 


4i 


D/ 1 0\ 


. it •^iU Tf A T>n/ r^tj CD A I^TTI^MC 

:0 MUi^* A i/iV* Uf riCAvilUXNa 








4i 


4i 


D/ 1 0\ 














D^ 1 0\ 


• ' ft •CTTUTPT re nW PAMPT PY T7D ArH'TOWC 
- ' • O OlXw^JUlF* UF CUX^U^JUD A FiCnWi i iUXN d 
















p^l7^ 










P^ 1 0\ 














P/ 1 Q\ 


.11 SO 1 IMAl lUn 0( AFFrvUAllVIn A lUIN 














• 10 •rv^w PPT PDA/'n^r^MC jt^ t^ppimat c * 


C( JO^ 




p^<^ 






D/ 1 Q\ 


iQ »/^r>w Diyp pDArn^triMC a ppdppmt* 








4i 


4i 


D^ 1 Q\ 


14 VAJMrUT* WlTn UcLi A fKAC» KUUMU 








4i 


4i 


D/ 1 Q\ 


; 15 COMrUTATlUN Ur f£RLcNT 


P/OQ\ 

C(3o) 




p/e\ 


C(3z) 


4i 


4i 


: 1 0 CUIMCcr A Ur rKUrUKl lUM 


P/'K\ 








4i 


4i 


* 1^ ir^/%%Jt»TrPA»nTA1iT />TS DDADADTmXTCI 

; 17 COMrUTATIUN Ur rRUrUKllUMd 


P/K\ 

L( id; 




p/<\ 


C(33; 


P/OQ\ 

L(Zo; 


4i 


^■•*10 lADDT T/^ f^D DATTA AD DDODADTTAWO' 

. lo ArrLlL.* LrF KAllU UK JrKUrUKliUXNd 






\0\j} 


p/io\ 
CC33J 


P^OQ** 
CvZo^ 


4i 


' - «A tAPDT TA T AWC AP PVDt^MPKTTC' 




p^ 1 1^ 






p/0 1 \ 


4i 


^Ati/DDC AP Ml Mw CAIPMT»IPfA MAT AT • 

4U rU WcKo UF lU & oUlciNlirlw INUlAl* 










P/OQ\ 

Hzyj 




Ol T3VDnVPMT WTTW IMTPrtP AT PVPOMPM ' 


* 








P^OQ'i 
CvZ^j 




' : .0<> iCA POHT nP PPPPRPT COTTAPPQi 

zz ijvi* Kuui ur rciirxivi d^UAiwd 


* 








P^77^ 
C(Z/; 




. ZJ dlmr;wirlL#AllUXN UF HWWAw 








* 


P^^rfii^ 
CvZO^ 




. ; .'Z4 AUU« OC pUo* UF dv» XvUUld 














: vr.. ZD mUl^* & 1^1 V* UF KUUlo 














Ol% 'AAMV PPT P AT^TPAT C j& PAT PV PO ' 


M^'%A^ 












0*7 *D ATT AM AT TO' AP MtnUTPDA A T^PNIOMT ' 
Z/ KAIiUriAI^IZ** UF riUMsKA* o& J^iuNUinl* 


M^QA^ 
111 




4i 






41 


' ' OQ IAT^T> AMr% CTn> AO DA ATA AT OVDDP * 

.. Zo AUi/» AMD oUo» UF KAUIL AL cArKc* 




Kr/o\ 


4i 






4t 


tKTTT1k/r AAT ATT tl// DVDAMPXJTC A DAT> • 


M/1A\ 


4i 


4i 


1^ 


4i 


4i 


'AT AP AAT ATT W/ PVPAMPWTC A D AT> ' 
: . AJLUC* V#AJLCU» W/ CAFUINCiNld OC KAii* 




4i 


4i 


4i 


4i 


4i 


01 trjArTADTXTA Pm CTHiTDT T AT AO OVDDP ' 

o\ FAv^iUKiMU 0& olMrLrL ALUc* cArKJc* 




4t 




IN^ J«tJ| 


4i 




nf% »nCTIlUI APPDAYT WTTIT PAATPAT C ' 
, -v^ JZ collM* OC AFFxCUAi* WliXl KAUiCAI^d* 










c^z/; 




iAT rJP nPPP ATTHM HP T ITPP AT CVMPHT ' 
nXJJBf UrC«K/% ilUXN UF JLllCJCv/\l^ dXM0UI^ 


* 












> lA iCTMPT TP np PHT YMH PV rtPOTIPIKH * 
,c- Of uilVZF^IF* 1/F FWi^inw* OX wl^WWFAiNw* 










P^'*7\ 




^< 'AT^T^ CTTP np PHT VMOMTAT ^' 














'ili TPVATTTATTHM OP ▲ W^T VMHMTAT M ' 














17 'MTTT np MOMniurTAT WITH A PTIT VMH ' 




* 










Kv QO iMTTT OPTWn PTMHMTAT C 
70 Jo MUJU* ur i WU OUNUMIAJ^ 


KT^'2A^ 






IN( J 


cvjz; 




•T^TVTCTAM AP DAT VMAMTAT C 
J" UlVloiUIN Ur FUirfXiNUiMlAli«a 


KT^1A^ 












' ZA tCOTTAPTMO A PTMPMTAT * 


IN V J*f^ 






IN V JO^ 






M - 41 •FACTOR. POLYNOMIALS' 


N(34) 






N(30) 


C(32) 




42 'FACTOR. TRINOMIAL OVER INTEGERS ' 


N(34) 






N(34) 


C(31) 




% 43 PACTOR. PERFECT SQ. TRINOMIALS ' 


N(34) 






N(34) 


C(31) 




44 'SIMPLIR OF COMPLEX NUMBERS' 


N(34) 


N(9) 


N(5) 


N(35) 






45 "ONE UNKNOWN WITH NUM. COEFFi; 










C(32) 




|# 46 'ONE UNKNOWN WITH LIT. COEFFl.' 


* 








C(32) 





C: Core Given in parenthesis is the number of sections when 

P: Prior computing more than 80% Teachers' agreement. 

N: Not Taught 

; Eclectic: no category received 80% agrement among Teachers 



' 1988 TEAOIER CONTENT COVERAGE 

■^f ' (80% Teachers* agreement on each topic) 



ITEMS IJOWERTIMN MATHA MATHB PRE ALGEBRA (SQMBIRY 

PRE ALGEBRA 1 

ALGEBRA 



9^- 



; 47 'SIMPLE LIN. EQUA, IN ONE WKNOWN' 
•V48 TWO UNKNOWN BY ELIMINATION' 

49 TWO UNKNOWN BY SUBSTrrunON' 

50 'APPLICATION OF EQUATIONS' 

51 K3ENERATING EQUATIONS FROM DESCR.' 

52 'SOLV, EQUA. FROM FACTORED FORM' 

53 'SOLVING QUAD£QUAT3Y FACTORING ' 

54 'SOLV. QUAD. EQUA. BY QUADRATIC • 

55 'GRAPHS OF QUADRATIC RELATIONS' 
:56 ONE UNKNOWN WITH NUM. COEFFI.' 

57 'SOLUT, OF QUADRATIC INEQUALITIES' 

58 "GRAPHING LIN. INEQ. IN ONE UNKNO' 

59 'SIMPLIF. OF A RATIONAL EXPRE.' 

60 EVALUATION OF A RATIONAL EXPRE. ' 

61 'ADD. & SUB. OF RATIONAL EXPRE.' 

62 mjL. & DIV. OF RATIONAL EXPRE.' 
63 'PROBABILITY' 

64 -DESCRIPTIVE STATISTICS' 

65 'GRAPH READING' 

66 'LOCATI. OF POINTS IN CORD. PLANE' 

67 'DISTANCE BET, TWO POINTS IN COR.' 

68 "PERIMBTER & AREA OF TRIANGLES.SQ 

69 'CIRCUMFERENCE & AREA OF CIRCLE' 

70 "VOL. OF CUBES, CYLINDERSJflECrAN.' 

71 "FINblNG SUM OF INTERIOR ANGLES' 

72 'ISOSCELES & EQUILATERAL TRIANGLE' 

73 'APPLIC. , CONGRUENT TRL\NGLES' 

74 'APPUC. , SIMPLE TRL\NGLES' 

75 'PYTHAGOREAN THEOREM & SPECI. TR.' 

76 PARALLELISM & PERPENDICULARITY' 

77 •PROOFSCFORMAL DEDUCTIVE DEMONST.' 

78 TRANSFORMATIONSCTRANSLATION.' 

79 'VECTORS' 

80 'SIMPLrF. & EVALU. OP EXPRESS.' 

81 'SOLUTION OF EQUATIONS' 

82 •FUNCT. CONCEPT & USE OF NOTATION' 

83 'FUNCr. EVALUATION USING SUBSTIT.' 

84 'COMPOSITION OF FUNCTION' 

85 'GRAPHING OF FUNCTION' 

86 'NUMERICAL FUNCTIONALEVALUATION' 

87 'SUBSTTTUTING LTTBRAL EXPRESS.' 

88 DEFINTTION, LAWS & RULES' 

89 INVERSE RELATION BET. LOG. & EXP' 

90 'SOLUTION OF LOG. AND EXP. FUNCT'.' 

91 'GRAPHING OP LOG. AND EXP. FUNCT.' 

92 TIND. ALGEBRAIC EXPRESS' 

93 ©ESCRTO. VARIATIONS OF FUNCTION ' 
^94 Vtm. SIDE LENGTHS IN SPEC.TRIA.' 



N(34) 

N(34) 

N(31) 

N(31) 

N(34) 

N(34) 

N(34) 

N(34) 

N(34) 

N(34) 



* * 

N(9) * 
N(9) ♦ 



N(9) 
N(9) 
N(9) 
N(9) 

N(9) 



N(5) 



N(5) 
N(5) 



* 
* 

N(39) 
N(39) 
N(39) 
N(39) 

N(34) 



C(32) 
C(31) 
C(31) 
C(32) 
C(30) 
0(28) 
C(28) 
0(28) 

0(32) 



m 95 'GRAPHINO TRIGONOMETRIC FUNCTIONS' 
1W TffibUCiNG TRIGONOMETRIC EXPRE.' 



97 'PROOF OF TRIGONOMETRIC IDENTTTIE' 





* 


* 






* 




* 


* 


* 




* 




* 


* 


* 




* 




* 


* 


* 




4c 




* 




* 




* 






* 










* 


« 


* 








* 


* 


* 




* 




* 




* 




* 








* 


* 


* 




* 


* 


* 








* 


* 


* 




0(21) 




* 




* 


* 


0(21) 








* 


Nf27) 


0(21) 








* 


* 


0(21) 








* 


* 


0(21) 








* 


* 


0(21) 








* 


* 


0(21) 




N(9) 






* 


0(21) 


N(31) 


N(9) 


N(5) 


N(39) 


N(28) 


0(21) 


N(31) 


N(9) 


N(5) 


N(39) 


N(30) 




N(31) 


N(9) 


N(5) 


N(39) 


N(30) 




N(31) 


* 


N(5) 


* 


0(29) 




N(31) 


N(9) 


N(5) 


* 


0(29) 




N(34) 


* 


N(5) 


N(36) 


* 




N(34) 


* 


N(5) 


N(36) 


* 




N(34) 


N(9) 


N(5) 


N(37) 


* 


« 


N(34) 


N(9) 


N(5) 


N(37) 


* 




N(34) 


* 


N(5) 


N(39) 


N(27) 


N(18) 


N(34) 


N(9) 


N(5) 


N(39) 


* 


N(18) 


N(34) 


N(9) 


N(5) 


N(39) 


N(27) 


N(18) 


N(34) 


N(9) 


N(5) 


N(39) 


N(27) 


N(18) 


N(34) 


N(9) 


N(5) 


N(39) 


N(27) 


N(18) 


N(34) 


N(9) 


N(5) 


N(39) 


N(27) 


N(18) 


N(34) 


N(9) 


N(5) 


* 


N(30) 




N(34) 


N(9) 


N(5) 


* 


N(30) 


N(17) 


N(34) 


N(9) 


N(5) 


N(37) 


N(29) 




N(34) 


N(9) 


N(5) 


N(39) 


N(30) 


N(18) 


N(34) 


N(9) 


N(5) 


N(39) 


N(30) 


N(i8) 


N(34) 


N(9) 


N(5) 


N(39) 


N(30) 


N(18) 



1989 TOACHER CONTENT COVERAGE BY COURSES ■ BY SUBTOPIC 
(80% Teachers' agreement on each topic) 



ITEMS LOWBimN MATH A MAl'HB PRE ALGEBRA GBSMmRY 

PRE ALGEBRA I 



1 'BASIC OPERATIONS WITH SIGNED NO.' 


C(22) 


* 




* 




P(19) 


2 TRIME FACTORIZATION' 


C(22) 


C(6) 




C(12) 






3 TINDINO DISTANCES ON NUMBER LINE' 


* 


C(6) 




C(ll) 




C(19) 


4 XJSINO DEFINITION OF DIVISIBILITY' 


C(21) 


C(6) 


C(3) 


* 






5 'ADD. & SUB. OF FRACTIONS' 




P(6) 


P(3) 








6 im. & DIV. OF FRACTIONS' 




P(6) 


P(3) 








7 'ORDER & COMPARISON OF FRACTIONS ' 




P(6) 


P(3) 






P(20) 


8 'SIMPLIF. OF COMPLEX FRACTIONS' 




P(6) 


P(3) 








9 'ADD. & SUB OF DECIMALS' 




P(6) 


P(3) 








10 "MUI.. & DIV. OF DECIMALS' 




P(6) 


P(3) 








11 "ESTIMATION & APPROXIMATION' 


C(24) 


P(6) 


P(3) 








12 'CONV. BET. FRACnONS & DECIMALS ' 




P(6) 


P(3) 








13 'CONV. BET. FRACTIONS & PERCENT 




P(6) 


P(3) 








14 'COMPUT. WTTH DECI & FRAC. ROUND.' 


C(24) 


P(6) 


P(3) 








15 'COMPUTATION OF PERCENT' 


C(21) 


P(6) 


P(3) 


C(12) 






16 'CONCEPT OF PROPORTION' 


C(21) 






C(i3) 






17 'COMPUTATION OF PROPORTIONS' 


C(21) 






C(12) 






18 'APPUC. OF RATIO OR PROPORTIONS ' 


C(21) 






C(12) 






19 'APPLIC. LAWS OF EXPONENTS' 


* 


C(6) 


C(3) 


* 


C(23) 




20 "POWERS OF 10 & SCIENTIHC NOTAT.' 


* 


C(6) 


C(3) 


* 






21 "EXPONENT. WTTH INTEGRAL EXPONEN.' 


* 


C(6) 


C(3) 


* 


C(21) 


P(17) 


22 'SQ. ROOT OF PERFECT SQUARES' 


• 






C(10) 






23 'SIMPLIFICATION OF SQ. ROOTS' 




« 


« 








24 'ADD. & SUB. OF SQ. ROOTS' 


« 


« 




« 


C(22) 




25 'MUL. & DIV. OF SQ. ROOTS' 


* 


N(6) 


* 


* 


C(22) 




26 'CONV. BET. RADICALS & RAT. EXPO.' 


N(25) 


N(6) 


N(3) 


* 


* 




27 "RATIONALIZ. OF NUMERA. & DENOMI.' 


N(25) 






* 


C(18) 




28 'ADD. AND SUB. OF RADICAL EXPRE. ' 


N(25) 


N(6) 


N(3) 


N(ll) 


* 




29 "NUM. CALCU. W/ EXPONENTS & RAD. ' 


N(25) 








C(18) 




30 'ALOE. CALCU. W/ EXPONENTS & RAD.' 


N(25) 


N(6) 


N(3) 




• 




31 "FACTORING & SIMPLI. ALGE. EXPRE.' 


N(25) 


* 




• 


« 


« 


32 'ESTIM. & APPROXI. WTTH RADICALS.' 


N(25) 








• 




33 'ALGE OPERATION OF LITERAL SYMBOL' 


N(25) 




« 


C(9) 


C(22) 




34 'SIMPLIF. OF POLYNO. BY GROUPING.' 


N(25) 




« 




C(24) 


P(19) 


35 'ADD. & SUB. OF POLYNOMIALS' 


N(25) 




« 


* 


C(24) 


P(19) 


36 'EVALUATION OF A P0LYN0MlAL(l/2) ' 


N(25) 




« 




C(24) 




37 'MUL. OF MONOML\L WFTH A POLYNO. ' 


N(25) 




« 




C(24) 


P(i9) 


38 'MUL. OF TWO BINOMIALS' 


N(25) 






N(10) 


C(24) 


P(19) 


39 DIVISION OF POLYNOML\LS' 


N(2S) 


* 


« 


N(10) 


C(24) 




40 'SQUARING A P iOMIAL' 


N(25) 




« 


N(10) 


C(24) 


P(19) 


41 "FACTOR. POLYNOML^LS' 


N(25) 




* 


N(10) 


C(24) 


P(19) 


42 "FACTOR. TRINOMIAL OVER INTEGERS " 


N(25) 


N(2) 




N(10) 


C(24) 


P(19) 


43 "FACTOR. PERFECT SQ. TRINOMIALS' 


N(25) 






N(10) 


C(24) 


P(19) 


44 "SIMPLIF. OP COMPLEX NUMBERS" 


N(25) 


N(6) 




N(10) 


C(21) 




45 ONE (UNKNOWN V/TTH NUM. COEFFI." 


* 


C(6) 






C(24) 




46 "ONE . 'NOWN WITH LIT. COEFFI.' 


N(22) 








C(24) 




47 'SIMPLE LIN. EQUA. IN ONE UNKNOWN" 


* 


C(6) 






C(24) 




48 "TWO UNKNOWN BY ELIMINATION" 


N(25) 


N(6) 






C(23) 




49 TWO UNKNOWN BY SUBSTITUTION" 


N(25) 


N(6) 






C(23) 


P(19) 


50 'APPLICATION OF EQUATIONS" 


N(24) 




C(3) 




C(24) 





30 



1989 TEACHER CONTENT COVERAGE BY COURSES - BY SUBTOPIC 
(80% Teachers' agreement on each topic) 



ITEMS 




MATH A 


MATHB 


PRE 


ALGEBRA 




PRE 

At /inDD A 






ALGEBRA 


1 




Si \j?&N£RATiNu SQUATIONS rRUM DcSCR« 


N(21; 


C(0) 






C(24) 




Si c<UI#V« oyUA* rKUM rAv^rUKcU rvlKM 


XT/OCX 


N(0) 


N(3) 




C(23) 




S3 SULVINu QUAD.£QU ATJSY r ACTURJNu 


N(2S} 


N(0) 






O/ A 

C(23) 




54. SOLVlrlu AU. cljUA. Bi (j|UALiKAllC« 


N(2S} 


N(o) 


XT/0 \ 

N(3) 


rit 


Ik 




5d uRArHS Ur vUAUUATIC RsLATlUISS 


XT/OCX 






4i 




XT/ 1 Q\ 


DO \}NS UNKNOWN WITH NUM. COcrrI, 


N(25; 








C(24} 




5 J SOLUT. OF QUADRATIC INEQUALiTlEiS 


N(25} 












So \IRAPHINO LIN. INEQ. IN ON£ UNKNO 


N(25; 












59 SIMPLIF. Or A RATIONAL EXPRE. 


N(24) 


C(o) 


C(3; 


C(24} 






tBV7A' T f A >t'*l / WT OB A TIA^TOVTAT nWBB t 

60 IBVALUATION OF A RATIONAL EXFRE. 


XT / ^ 4 \ 

N(23} 


C(6) 


C(3) 




o/ ^ \ 

C(24) 




61 ADD, & SUB. OF RATIONAL EXFRE. 


N(25} 








C(24) 




62 ^oUL. & DIV. OF RATIONAL EXFRE. 


N(2S} 








C(24) 




63 rROBABILITY^ 




C(o) 


O/Q \ 

C(3) 


XT/A\ 

N(9) 




N(20) 


64 IjESCRIFTIVE STATISTICS 




C(o) 


C(3) 


N(9) 




XT/ O A\ 

N(2U} 


6p uRAFJn READINu 














00 LOCATL Or rOINTa IN v^ORO. rLANc 




ii 


ii 


i^i 1 A\ 
C(10) 




O/ 1 0\ 

C(18) 


07 DISTANLE BET. 1 vvU rOIN15 IN COK. 


4i 










/^/ 1 o\ 

C(19) 


68 FERIMETER & AREA OF TRIANuLEStSQ 








C(ll) 




C(21) 


69 CIRCUMIERENCE & AREA OF CIRCLE 




ifc 




O/ f 1 \ 

C(ll) 




C(21) 


70 VOL. OF CUBESt CYLINDERStRECTAN. 








O/ A\ 

C(9) 




O/O A\ 

C(20) 


71 rINDINu SUM OF INTERIOR ANGLES 




C(o) 


C(3) 






O / 1 A\ 

C(19) 


ITCOCODT ISO Pm BOTTTl AT*CDAT TUT A KT/^T t?> 

72 ISOSCcIrfSS & EQUILATERAL jLRIANuLE 




C(o) 


C(3) 


4l 




O / 1 A\ 

C(19) 


73 ArrLlL« i COINURUENl IKIANULEd 


4i 




iii 


4i 




ri/ 1 o\ 
C(19) 


74 AFFLIC. 9 SIMPLE TRIANULES 




ii 




ii 




C(19) 


75 TYTHAuOREAN THEOREM & SPECL TR. 




C(6) 




/^/ 1 AN 

C(10) 




o/ 1 n\ 

C(i7) 


70 PARALLELISM ct PERPENUICULARII Y 












/^/ 1 

C(17) 


77 xROOFS(FORMAL DEDUCTIVE DEMONST. 


XT/O ff \ 


XT/4% \ 

N(0) 


XT/0> 


XT/ 1 A\ 

N(10} 


XT / 1 A \ 

N(19) 


O/ 1 'VN 

C(17) 


TO inm A VTC1?OnU# A'PTOXTC/*T^ AXTCT AI^TOXT 1 

78 TRANSFORMATIONSCTRANSLATION. 


N(2S} 


XT/£\ 

N(D) 


N(3) 


XT/ 1 A\ 
N(10} 


XT / ^ ^ \ 

N(22) 




79 VECTORS 


N(25; 


N(6) 


N(3) 


XT/ 1 1 \ 

N(l I; 


XT / 0 \ 


XT/') 1 \ 

N(21) 


on iCTT^iTDT TC ^ T3\/AT TT OC WDDtSQC 1 

oU SIMPLIr. & EVALU. OF EXPR£dS« 


III 








C(22) 




Q1 IC/^T TrrTI^Xf fW T3/^TTA•^TAM0• 

ol dOLUlIUN Or EQUAlIUNo 


4i 




4i 


4i 


Cv22; 




o2 rUXNLI* LUMLErl <SC U5o Ur INUlollUIN 


IN(2d j 




4i 


XT/ 1 1 \ 






01 ttnXKif^ tSV AT TTA*PT#^XT TTCTNin CTTOCTrri 

oJ rUNLI. cVALUAilUN USINU oUodIIi« 






4i 


XT/ 1 1 \ 






o4 CUMP051II0N Or r UNCI ION 


XT/Off \ 


N^o; 


4i 


XT/ 1 1 \ 




XT/ 1 7\ 


Off I/1T> A DllTM/^ fW CTTKTr^TAKfl 

o5 uRAPnINu Or rUNL«IION 


IN(2d; 


iM(o; 


4i 


XT/ 1 1 \ 






OjS XTTTIkirCDTOAT CTTXTOT^OM T3\/AT TTATTOXJI 

oO. NUMERICAL rUNCilON EVALUATION 


N(2d; 


N(o) 


N(3) 


XT/ 1 1 \ 

N(I \) 






Of >CTTT>C*l*r'PI rPTXT/^ T l'T*PT> AT CVDT^CCiC 1 

87 SUBSTiTUTINu LITERAL EXPRESS. 


XT/Off \ 


N(6) 


N(3) 


XT/ 1 1 \ 

N( 1 1} 


XT / 1*7 \ 

N(17; 


XT/ 1 0\ 


OO tr%19CTXn*FTOXt T AttfC P» OTTT BCt 

88 jJEFINiriONt LAWS & RULES 




N(0) 


XT/O \ 

N(3) 


XT/ 1 1 \ 

N(l 1; 


XT / 1 ^ \ 

N(17) 


XT / O 1 \ 

N(21) 


OA iTxnt^nnCB viw ai^toxt ncr* t o/?i lovni 

89 INVERSE RELATION BET. LOu. & EXP 


N(2S} 


N(6) 


N(3) 


XT/ 1 \ 

N(l 1} 


XT i % 1\ 

N(17) 


XT / O 1 \ 

N(21) 


90 SOLUiION OF LOO. AND EXP. FUNCT. 


N(2S) 


N(6) 


N(3) 


XT/ 1 1 \ 

N( 1 1) 


XT / 1 *? \ 

N(17) 


XT/ O 1 \ 

N(21) 


At too AnUTXT/^ OC T Ort AK1T\ PVO TSTTXV^T • 

91 ORAPnINO OF LOU. AND EXP. FUNCT. 


N(25} 


N(0) 


N(3) 


XT/ 1 1 \ 

^\ 1 1> 


XT/ 1 

NvI7) 


XT/ IIS 

N(21) 


92 *FZND. ALGEBRAIC EXPRESS' 


N(25) 


N(6) 


N(3) 


N(10) 


N(18) 


* 


93 DESCRIB. VARIATIONS OF FUNCTION ' 


N(2S) 


N(6) 


N(3) 


N(10) 


N(18) 


XT / ^ AV 

N(20) 


94 HND. SIDE LENGTHS IN SPEC.TRIA.' 


N(25) 


* 


♦(3) 


N(10) 


N(18) 


* 


95 'ORAPHINO TRIGONOMETRIC FUNCTIONS' 


N(25) 


N(6) 


N(3) 


N(ll) 


N(18) 


N(20) 


96 REDUCING IRIGONOMETRIC EXPRE.' 


N(25) 


N(6) 


N(3) 


N(ll) 


N(18) 


N(20) 


97 "PROOF OF TRIGONOMETRIC IDENTITIE' 


N(25) 


N(6) 


N(3) 


N(ll) 


N(18) 


N(20) 
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Table 3. Average P-values by teachers' reports of topic coverage on the MDTP Algebra 
Readiness^ Elementary Algebra tests and the SIMS Benchmark test. 



Teachers' 
Report of 
Topic 
Coverage 



Average P-values (Number of Test Items)* 
Number of Teachers / Avg. Number of Students'^* 



MDTP 
ALGEBRA READINESS 



MDTP 

SI^gMPNTARY AIQEBRA 



SIMS 
BENCHMARK 



A. Taught as New 

B. Extended & 

Reviewed 

C. Reviewed only 

D. Assumed as Prereq. 

E. Taught Later 

F. Not in Curriculum 

G. Don't know 

H. No Response 





•§8 


'§? 


•?? 


'§? 


'88 


.41(50) 


.42(50) 


.46(48) 


.45(46) 


.44(39) 


36(38) 


10/326 


25/563 


8/183 


16/497 


10/160 


25/99 


.41(44) 


.41(46) 


.45(31) 


.47(47) 


.42(32) 


.35(34) 


7/330 


22/550 


7/178 


16/515 


7/159 


22/100 


.41(34) 


.41(43) 


.47(40) 


.47(46) 


.43(15) 


.33(28) 


6/333 


13/542 


7/186 


11/510 


6/211 


11/87 


.47(17) 


.34(4) 


.46(44) 


.46(49) 


.48(9) 


.38(22) 


1/394 


2/454 


6/184 


10/513 


1/207 


1/121 


.42(25) 


.41(35) 


.43(23) 


.45(31) 


.44(29) 


36(37) 


6/330 


18/553 


6/174 


12/505 


6/170 


18/100 


.36(19) 


.40(17) 


.37<4, 


.41(12) 


.45(27) 


38(23) 


3/286 


8/551 


2/158 


1/465 


3/153 


9/100 




32(8) 


.42(13) 


.47(16) 




33(8) 




3/441 


l/:64 


1/533 




6/72 


.38(16) 


.38(19) 


.45(8) 


.43(23) 


.45(27) 


36(32) 


1/290 


5/503 


1/185 


2/475 


2/153 


5/94 



* The average P-value for each response choice is determined by a multi-step process. First, individual test 
items are assigned to topic categories. Then, the performance of students on each item is assigned to topic 
coverage categories based on the responses of their teachers. Finally, the P-values for each item that appear in 
a given topic coverage category multiplied by the number of students who answered correctly and are 
averaged across items. For example, the average P-value for Review Only on the MDTP Algebra Readiness 
Test is .41 across the 43 items where thirteen teachers chose "Reviewed Only" to describe coverage of the 
topic. 

** The number of students are averaged by dividing by the number of items which are assigned to topic 
categories. 



33 



